Adaptive Estimation in Autoregression or Β-mixing Regression via Model Selection
نویسندگان
چکیده
We study the problem of estimating some unknown regression function in a β-mixing dependent framework. To this end, we consider some collection of models which are finite dimensional spaces. A penalized leastsquares estimator (PLSE) is built on a data driven selected model among this collection. We state non asymptotic risk bounds for this PLSE and give several examples where the procedure can be applied (autoregression, regression with arithmetically β-mixing design points, regression with mixing errors, estimation in additive frameworks, estimation of the order of the autoregression ...). In addition we show that under a weak moment condition on the errors, our estimator is adaptive in the minimax sense simultaneously over some family of Besov balls.
منابع مشابه
Optimal model selection for stationary data under various mixing conditions
The history of statistical model selection goes back at least to Akaike [Aka70], [Aka73] and Mallows [Mal73]. They proposed to select among a collection of parametric models the one which minimizes an empirical loss plus some penalty term proportional to the dimension of the models. Birgé & Massart [BM97] and Barron, Birgé & Massart [BBM99] generalize this approach, making the link between mode...
متن کاملAdaptive density estimation of stationary β-mixing and τ -mixing processes
We propose an algorithm to estimate the common density s of a stationary process X1, ..., Xn. We suppose that the process is either β or τ -mixing. We provide a model selection procedure based on a generalization of Mallows’ Cp and we prove oracle inequalities for the selected estimator under a few prior assumptions on the collection of models and on the mixing coefficients. We prove that our e...
متن کاملPenalized Bregman Divergence Estimation via Coordinate Descent
Variable selection via penalized estimation is appealing for dimension reduction. For penalized linear regression, Efron, et al. (2004) introduced the LARS algorithm. Recently, the coordinate descent (CD) algorithm was developed by Friedman, et al. (2007) for penalized linear regression and penalized logistic regression and was shown to gain computational superiority. This paper explores...
متن کاملThe Doubly Adaptive LASSO for Vector Autoregressive Models
The LASSO (Tibshirani, J R Stat Soc Ser B 58(1):267–288, 1996, [30]) and the adaptive LASSO (Zou, J Am Stat Assoc 101:1418–1429, 2006, [37]) are popular in regression analysis for their advantage of simultaneous variable selection and parameter estimation, and also have been applied to autoregressive time series models. We propose the doubly adaptive LASSO (daLASSO), or PLAC-weighted adaptive L...
متن کاملAutomated Estimation of Vector Error Correction Models
Model selection and associated issues of post-model selection inference present well known challenges in empirical econometric research. These modeling issues are manifest in all applied work but they are particularly acute in multivariate time series settings such as cointegrated systems where multiple interconnected decisions can materially a¤ect the form of the model and its interpretation. ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2001